Generating Functional Analysis of the Dynamics of the 
Batch Minority Game with Random External Information 
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We study the dynamics of the batch minority game, 
with random external information, using generating func- 
tional techniques a la De Dominicis. The relevant control 
parameter in this model is the ratio a = p/N of the number p 
of possible values for the external information over the num- 
ber A'^ of trading agents. In the limit ^ oo we calculate 
the location of the phase transition (signaling the onset 
of anomalous response), and solve the statics for a > ac ex- 
actly. The temporal correlations in global market fluctuations 
turn out not to decay to zero for infinitely widely separated 
times. For a < Qc the stationary state is shown to be non- 
unique. For Q — » we analyse our equations in leading order 
in Q, and find asymptotic solutions with diverging volatility 
a = 0{a~'^) (as regularly observed in simulations), but also 
asymptotic solutions with vanishing volatility a = 0{a^). 
The former, however, are shown to emerge only if the agents' 
initial strategy valuations are below a specific critical value. 

PACS numbers: 02.50.Le,87.23.Ge,05.70.Ln,64.60.Ht 



I. INTRODUCTION 

The minority game has been the subject of much (and 
at times heated) debate in the physics literature recently. 
It was originally introduced in ^ , as a variation of the El 
Farrol-Bar problem to serve as a simple model for a 
market in economics, and has since then attracted much 
attention (see e.g. [^). The players in the minority game 
are trading agents who, at every stage of the game, have 
to make a decision whether to buy or to sell, on the basis 
of both publicly available information (i.e. past market 
dynamics, weather forecasts, political developments or 
stock prices) and their personal strategies. Those agents 
who find themselves having made the minority decision 
make a profit, while those agents which opted for the 
majority choice loose money. After each round all agents 
re-value their strategies. There are many variations on 
the precise implementation of this game, yet most share 
the same main features of the emerging market fluctu- 
ations. The important control parameter in the model 
is the ratio a = p/N of the number p of possible val- 
ues for the external information over the number N of 
trading agents. If this ratio a is very large, the agents 
exhibit essentially random behaviour. This is reflected 
in the fluctuations of the total bid, being the sum of all 
buyers minus the sum of all sellers. If less external infor- 
mation is available (or used) to base decisions upon, i.e. 



for reduced a, the mismatch between buyers and sellers 
is found to decrease, and the market behaves more ef- 
ficiently. This behaviour is now understood quite well 
on the basis of the replica calculations in [Q-^ and the 
crowd-anticrowd theory of [Q| . The situation is much less 
clear, however, when a becomes very small. One possi- 
bility is that the market becomes extremely efficient, and 
the number of buyers almost equals the number of sellers. 
Another possibility is that the mismatch between buyers 
and sellers diverges if the amount of shared (i.e. exter- 
nal) information becomes small, and the market becomes 
extremely inefficient (see e.g. ^,^)- 

In this paper we solve the dynamics for the original 
many agent model, using the exact generating functional 
(or path integral) techniques introduced in After 
defining the rules of the game we derive in the limit 
A'^ — > oo an equivalent description in terms of an effective 
stochastic non-Markovian single agent process, for which 
we calculate the first time steps. For sufficiently large 
values of a, we can solve the statics exactly under the 
assumption of absence of anomalous response. We cal- 
culate the point ac where this assumption breaks down, 
resulting in a phase transition; our value for ac is identi- 
cal to that found in Q . The present dynamical approach 
allows us to study the behaviour of the market below ac- 
In this region there exist persistent non-static solutions 
which cannot be studied by the methods of [Q. Below 
ac the market is non-ergodic and the initial conditions 
of the agents determine the final stationary state of the 
market. For a — > we calculate the market volatility in 
leading order in a for the case where the agents are ini- 
tialised with only weak strategy preferences, leading to 
a diverging volatility with exactly the scaling exponent 
a = ©(a^a ) predicted in |^ on the basis of heuristic ar- 
guments. We find a critical value for the initial strategy 
valuations above which this solution no longer exists, and 
is being replaced by an alternative solution with a van- 
ishing volatility of the form a — 0{a^). Our dynamical 
approach allows in addition for the calculation of the two- 
time correlations in the global market fluctuations, by 
definition inaccessible with equilibrium methods (replica 
or otherwise), which are found to have a persistent com- 
ponent. Numerical simulations confirm our theoretical 
results convincingly. 
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II. MODEL DEFINITIONS 

There are N agents playing the game. We will 
only consider the case where N is very large, and ul- 
timately take the limit N ^ oo. The agents are la- 
beled with Roman indices i,j,k, etc. At each iteration 
round £ all agents are given the same (as yet unspec- 
ified) piece of external information , chosen ran- 
domly from a total number p — aN of possible val- 
ues, i.e. fj,{i) € {1, . . . ,aN}. In the original model ||] 
the history of the actual market is used as the informa- 
tion given to the agents. Each agent i has S strategies 
R^^ = {R\^^ . . . , Rf^) e {-1, 1}"^ at her disposal with 
which to determine how to convert the external informa- 
tion into a trading decision, with a £ {1, . . . , S}. Each 
component is selected randomly and independently 
from {—1, 1} before the start of the game, with uniform 
probabilities, and remains fixed throughout the game. 
The strategies thus introduce quenched disorder into the 
model. Each strategy of every agent is given an initial 
valuation or pay-off Pia (0) . The choice made for these 
initial values will turn out to be crucial for the emerging 
behaviour of the market. Given a choice fj,{£) made for 
the external information presented at the start of round 
£, every agent i selects the strategy ai{£) which for trader 
i has the highest pay-off value at that point in time, i.e. 
di {£) = arg max pia {£) , and subsequently makes a binary 

bid bi {£) = R^-^j^f.^ ■ The (re-scaled) total bid at stage £ is 

defined as A{£) = N-'^/^ J2t Next aU agents update 

the pay-off values of each strategy a on the basis of what 
would have happened if they had played that particular 
strategy: 

p.U£+l)^Pra{£)-R':l'^A{£) 

The minus sign in this expression has the effect that 
strategies that would have produced a minority decision 
are appreciated. 

This setup so far allows for an arbitrary number of 
strategies S. The qualitative behaviour of the market 
fluctuations, however, is found to be very much the same 
for all non-extensive number of strategies larger than 
one We therefore present results here only for the 
5 = 2 model, where the equations can be simplified 
considerably upon introducing for each agent the instan- 
taneous difference between the two strategy valuations, 
qi{£) — [pii{£) — pi2{£)]/2, as well as the average strategy 
LJi = {Rii+Ri2)/2 and the difference between the strate- 
gies — [Rii — Ri2)/2. The actually selected strategy 
in round £ can now be written explicitly as a function of 
Si{£) = sgn[qi{£)], viz. Ria,{i>] = i^i + Si{£)^i, and the 
evolution of the difference will now be given by: 

q^{£+l) = m - £.f\n^^''>+N-^-Y,(,fh,{£)l (1) 
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with Q, ^ N^^/^ J2j ^3 ^ It lia-s been observed in 

numerical simulations, see e.g. that the magnitude 



of the market fluctuations remains almost unchanged if a 
large number of bids are performed before a re-evaluation 
of the strategies is carried out. This is the motivation 
for us to study a modified (and simpler) version of the 
dynamics of the game, where, rather than allowing the 
strategy pay-off valuations to be changed at each round, 
only the accumulated effect of a large number of market 
decisions is used to change an agent's strategy pay-off 
valuations. This amounts to performing an average in the 
above dynamic equations over the choices to be made for 
the external information. If we also change the time-unit 
accordingly from £ (which measured individual rounds of 
the game) to a new unit t which is proportional to the 
number of pay-off validation updates, we arrive at 

q,it + l)^q,{t)~h,-J2j,jS,{t) (2) 

3 

where J.y = -^j/Nt^ and hi — • rj/vWr^, and with 

r2 = ann') = m?) = (K)'); ^^^^ = 

above particular choice of time scaling has been made 
only in view of it giving the simplest equations later. To 
make a connection with the original game, one must in- 
terpret the evolution of the qi (t) as described by (^ as the 
accumulated effect of order N iterations in the original 
model. Equation (^) defines the version of the minor- 
ity game analysed in this paper. It has been argued p^ ] 
that (H) can be converted into a continuous time limit 
of equation ([l]), upon replacing [qi{t -I- 1) — qi{t)]/\/l^ by 
dqi/dt. Strictly speaking, this is not true. A number 
of agents change their preferred strategy at every iter- 
ation of equation The size of their g's will be of 
the order of (half) the step size. In the continuous time 
limit, in contrast, this step size is lost; yet any discreti- 
sation used to integrate the continuous time differential 
equation obtained will effectively re-introduce an (arbi- 
trary) scale for the q' s. This is not so relevant when the 
only appearance of the qi is in sgn[(ji], but it is of impor- 
tance in the so-called Thermal Minority game , where 
terms like tanh[/3ffi] appear. We therefore prefer the dif- 
ference equation (g) over its continuous counterpart, and 
regard (^ as the equivalent of what in the neural net- 
works literature would be called the 'batch' version of 
the conventional 'on-line' minority game. For a more 
detailed discussion concerning the validity of a continu- 
ous time differential equation for the TMG we refer to 
]l3|,^Jl4|. Finally, the magnitude of the market fluctua- 
tions, or volatility, is given by cr^ = {A^) — {A)'^ . From 

the starting point A{£) = N-i Eik"^^^ + s»(^)C^^^] and 
on the time scales of the process (p|), one easily derives 




Purely random trading corresponds to (A) = and = 



2 



1. We will also define a more general object, the volatility 
matrix 'E.tt'- 



Eu'^{[A~{At)][A,,-{At>)]) 



(5) 



which measures the temporal correlations of the market 
fluctuations. Note that af = Ett- In the case where the 
average bid (A) is zero (which will turn out to happen 
in the present model), the volatility measures the effi- 
ciency of the market. Zero volatility implies that supply 
and demand are always at the same level, and that the 
market is extremely efficient. A large volatility implies 
large mismatches between supply and demand, and is the 
signature of an inefficient market. 



III. THE GENERATING FUNCTIONAL 

There are two compelling reasons for studying the 
dynamics of the minority game. Firstly, dynamical 
techniques do not rely on the presence of a Lyapunov- 
function, so that the MG can be studied for small a. 
Secondly, it is clear from our simulations, see the fig- 
ures below, that, at least on the relevant time-scales, the 
stationary state of the minority game can depend quite 
strongly on the initial conditions. One canonical tool to 
deal with the dynamics of the present problem is generat- 
ing functional analysis a la De Dominicis , originally 
developed in the disordered systems community (to study 
spin glasses, in particular). This formalism allows one to 
carry out the disorder average (which here is an average 
over all strategies) and take the N ^ oo limit exactly. 
The final result of the analysis is a set of closed equations, 
which can be interpreted as describing the dynamics of 
an effective 'single agent' pO| , p^ . Due to the disorder 
in the process, this single agent will acquire an effective 
'memory', i.e. she will evolve according to a non-trivial 
non-Markovian stochastic process. 

First we rewrite equation (^) as a Chapman- 
Kolmogorov equation describing the temporal evolution 
of an ensemble of markets; 

Pt+i{q) = jdqW{q\q')pt{q'), 

where, in the absence of noise, the transition probability 
density is simply 

W{q\q')=\[5{q, - q[ + h, + Y. ^^^''j^ 



dq 
(2^' 



with the short-hand s'^ = sgn[g^]. The moment generat- 
ing functional for a stochastic process of the present type 
is defined as 

Z[ip] = ( e^StS. 'A- (*)?•(*) ) 



= / Y[[dq{t) W{qit+l)\qm po(q(0)) 



X e 



By taking suitable derivatives of the generating func- 
tional with respect to the conjugate variables xp, one can 
generate all moments of q at arbitrary times. Upon in- 
troducing the two short-hands: 



tVN 



as well as Dq = Yl^^[dqi (t) / V2t:], Dw = ^^[dw ^ / \/2Tr] 
and Dx = O^^tM^t'/v^^Tr] (with similar definitions for 
Dq, Dw and Dx, respectively), the generating functional 
takes the following form: 

z[ip] = J DwDwDxDx e*5:tM[«+2r=^r+<(^^v^+^n] 

X J DqDq po(g(0)) eTvW 2,. C E J<?.(t)+2^,(t)] 
X e*5:ti[?.(t)(-3.(t+i)-9.(*)-e.(t))+v.(t)<j.(t)] (6) 

where we have introduced auxiliary driving forces 6i (t) to 
generate averages involving qi{t) (these can be removed 
later). 

IV. DISORDER AVERAGING 

At this stage we can carry out the disorder averages, 
to be denoted as which involve the variables — 

T^{R'^, - i?f2) and = N-^r^ Eji^n + R%) only. For 
times which do not scale with A'^ one obtains: 



5 T S t 



n 



= e 



where we have introduced Ctf = N^^ J2i 

Kw = N-^Y.^s,it)W), and Lw = N'^ Y.^9^it)W)■ 
We isolate these functions via the insertion of appropri- 
ate (5-functions (in integral representation), and define 
the corresponding short-hands DC = Yl^^,[dCtt' /V^], 
DK = YltAdKu'l^] and DL = Y{^^,[dLtr / ^] 
(with similar definitions for DC, DK and DL, respec- 
tively). Upon assuming simple initial conditions of 
the form po{q) — YiiPoiQi), the i-dependent terms in 
the disorder-averaged generating functional (^ are now 
found to factorise fully over the A^ traders, and we arrive 
at an expression of the following form: 



3 



Z[ip] = / [DCDC] [DKDK] [DLDL] 



^Nl'i'+<S>+n]+OiN°) 



(7) 



The sub-dominant 0{N^) term in the exponent is in- 
dependent of the generating fields {tjji{t)} and {9i{t)}. 
There are three distinct leading contributions to the ex- 
ponent in d). The first is a 'bookkeeping' term, linking 
the two-time order parameters to their conjugates: 

* i Tr [C^C + K'^K + L^L], 

The second refiects the statistical properties of the play- 
ers' arsenal of strategies: 



$ = a log 



X e 2 



DwDwDxDx e'EAiitwt+Stxt+wtxt 



5 T.tt'l^'t^t'+WtLtt,Wt,+2xtK^^,Wt,+XtCtt,x^,] 



(8) 



The third term, which contains the generating fields, will 
describe the (now stochastic) evolution of the strategy 
valuations q{t) of a single effective agent: 



f^-^^log jDqDqpoiqm e'^^ 



,g(t)[g(t+l)-g(t)-e.(t)] 
iEt'/'>(*)9(0-iS:tt'[s(*)C'„/s(t')+s(t)i?tt/$(t')+$(t)itt/?(t')] 



X e 



with s{t) — sgn[q{t)] and with Dq — J|Jc?g(i)/v27r], 
Bw = W^dwtl Dx = Yl^[dxt/V2n] (similar def- 
initions for Dq, Dw and Dx). The form of Eq. (|^) is 
suitable for a saddle-point integration in the thermody- 
namic limit N ~* oo. With a modest amount of foresight 
we define Gu' — —iKu'- Upon taking derivatives with 
respect to the generating fields {9i{t),^i{t)}, and using 
the built-in normalisation Z[0] = 1, we find that at the 
relevant saddle-point: 



i 

Lw = hm — 



92 



-Z[0] = 



(9) 
(10) 

(11) 



The first two are recognised to represent disorder- 
averaged and site-averaged correlation- and response 
functions. At this stage the generating fields are in prin- 
ciple no longer needed. We will put tjjiit) = and 
Oi{t) = 0{t), and find our expression for fl simplifying 
to 



n ^ log 



DqDq poiqm 



Extremisation of the extensive exponent ^' -I- $ -I- of (|^) 
with respect to {C, C, K, K, L, L} gives the saddle-point 
equations 



id<i> 



dCw 



Ktv = 



Gu' - 
0$ 



de{t') 



(13) 



whereas Lu' = 0. The effective single-trader averages 
(. . generated by taking derivatives of (p^), are defined 
as follows (note: s{t) — sgn[g(t)]): 



(/[{9}]>* = 



/Jg M[{q}]f[{q}] 
jDq M[{q}] 



M[{q}] = po(g(0))e-^^«' '^WC^tt'sit') 

Upon elimination of {C,K,L} via (|l^, we have now 
obtained exact closed equations for the disorder-averaged 
correlation- and response functions in the N 00 limit: 
namely (|l^), with the effective single trader measure (|l^). 



V. SIMPLIFICATION OF THE SADDLE-POINT 
EQUATIONS 

The above procedure is quite insensitive to changing 
model details; alternative choices made for the statistics 
of traders' strategies would simply lead to a different form 
for the function $ (^ , whereas changing the update rules 
for the strategy valuations of the traders (e.g. by making 
these non-deterministic, as in (l^,^) would only affect 
the details of the term il (p^). We now work out our 
equations for the present choice of model. Focusing first 
on <i>, we perform the Xt integrals, yielding Y[t ^[^t + Wt], 
and after performing the remaining x integrations we get 



$ = alog J DwDw e*^*'^'"" 



The Gaussian integration over the {wt} gives 



$ = — log dot D + alog Y\_ 



dwt 



/27r 



-5 Ett' ^tL^tiw^, 



X e 



-5 Eh' ffit[(a-«-ff)^0-'(l-»^)]„,fflt' 



where the entries of the matrix D are given by Du' = 
1 -I- Ctt' ■ We now take the derivative of $ with respect 
to Ltt' , as dictated by (p^), and subsequently put all 
Ltt' ^ 0. This gives 
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L = --ia{t - iKy^D{t - iK^)~^, 



and limi_^o ^ 



-Q;Trlog(l - iK), so that 
'a{t-iK)-^ C = 



We now write our final result in terms of the response 
function ([l^), via the identity K — iG, and find our 
effective single trader measure Af [{(7}] of (|l^) reducing 
to 



VI. THE FIRST TIME STEPS 

For the first few time steps it is possible to calculate the 
order parameters (correlation- and response functions) 
and the volatility explicitly, starting from the effective 
single trader measure (|l6|) . Note that Du' = 1 + Ctt' and 
that Ctt = 1 for any t. Significant simplifications can be 
made by using causality. For instance, we always have 
(1 + G)-i = E„>o(~l)"G'"' ^ith causality enforcing 



Poiqm / Dq e 



[G"] 



for t' >t- 



(21) 



X e 



(16) 



This describes a stochastic single-agent process of the 
form 

q{t + l) = q{t) + e{t) - a^(l + G)-;sgn[<z(t')] + V^v{t). p(g(l)k(0)) 

t'<t 

(17) 

Causality ensures that Gtt' = for all t' > t (so that 
(1 -I- G)^,^ = for f > t), and r]{t) is a Gaussian noise 
with zero mean and with temporal correlations given by 
{7^it)rjit')) = ^tt': 



At i = this immediately allows us to conclude that 
Soo = -Doo = 2. We now obtain from ( p^ the joint 
statistics at times t = 1: 



-[q{l)-q{0)-eiO)+a sen[q{0)]f / 4a 



an 



(22) 



Equation (^21), in turn, allows us to calculate Gio = 
(sgn[g(0)g(l)]), and Gio - 9(sgn[g(l)])./90(O): 



I] = (l + G)-lL'(l + G^)- 



(18) 



Gio 
Gio 



dq{0) p{q{0)) erf 



dq{0) p{q{0)) e 



|g(O)|+0(O)sgn[g(O)] - 
2 2Va 

[q sgn[9(0)]-9(0)-e(0)]V4Q 



The correlation- and response functions, defined by 
(p|,p^, are the dynamic order parameters of the prob- 
lem, and must be solved self-consistently from the closed 
equations 



Ct, 



(sgn[g(t)g(t')]). 



_ (9(sgn[g(^)])^ 

dm 



Note that Af [{g}] as given by ( p^ ) is normalised, i.e. 
jDg A/[{g}] = 1, so the associated averages reduce to 
(/[{9}]>. =lDq A/[{g}]/[{g}]. The solution of (|l|) can 
be calculated numerically with arbitrary precision, with- 
out finite size effects, using a technique described in 

Finally, in appendix ^ we calculate the disorder av- 
eraged re-scaled average bid (At) and volatility matrix 
Stt' = (At At/) - (At)(At'), for iV oo, as defined pre- 
viously in (^) and (||). Note that objects such as (At) 
must asymptotically become self-averaging, i.e. indepen- 
dent of the microscopic realisation of the disorder; hence 
"(A^)(A^ -> (A^ (At.) for TV ^ oo. We find the satis- 
factory result that the average bid is zero, and that the 
volatility matrix (and thus also the ordinary single-time 
volatility al ~ '^tt) is proportional to the covariance ma- 



trix (18) of the noise in the dynamics ( |l7| ) of the effective 
single agent: 



lim (A)t = 0, 



lim ^tt' 



N- 



(20) 



Thus the noise term ri(fy in the single agent process (|l^ 
represents the overall market fluctuations, and the covari- 
ance matrix ( p^ ) informs us of both single-time volatility 
and the temporal correlations of the market fluctuations. 



We can now move to the next time step, again using (|2 
where we need the noise covariances Sn and Siq: 

510 = ^[1 - G + 0(G2)]itAt'[a - + 0{Cf )\^ 

w 

= 1 + Gio ~ 2Gio 

511 = ^[1 -G + 0{G^)]uDtt'[t -G^ + 0(G^)2]t'i 

w 

= 2-2Gio[l + Goi] + 2[Gio]' 

Although this procedure can in principle be repeated 
for an arbitrary number of time steps, generating exact 
expressions for the various order parameters iteratively, 
the results become increasingly complicated when larger 
times are involved. 

It is interesting, however, to inspect further some spe- 
cial limits. We first turn to the (trivial) case where a is 
very small, p{q{0)) — S[q{0) — qa] and go is finite. Pro- 
vided |(?o| S> \/a as a —> 0, we immediately deduce from 
the above results that lima^o Gio = 1, liniQ_»o Gio — 0, 
and limQ,^o ^lo = limQ-+o ^ii — 2. Hence we find in 
leading order in a that q{l) = q{0) and r/(l) = ?7(0). One 
easily repeats the argument for larger times, and finds 
that, without perturbations, both the system variables 
q{t) and the noise variables rj{t) will remain frozen for 
times t ^ 1/ yfoL, the only remaining uncertainty in the 
noise being the realisation of 77(0): 

g(t) =(7o + iVa ??(0) + C(at) (a 0) 
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If sgn[(7o] 7^ sgii[?7(0)], the system will 'de-freeze' at the 
first instance where t > \qo/r]{0)^/a\. Since ry(0) is a 
zero average Gaussian variable, one should therefore for 
small a expect half of the population of traders (those 
with non-profitable initial random strategy choices) to 
commence strategy chances at time-scales t = ©(a" 2), 
whereas the other half will continue playing the game 
with their (for now profitable) initial strategy choices at 
least up to t = 0{a^^). 

It is also interesting to analyse the case where the game 
is initialised in a tabula rasa manner (which appears to 
have been common practice in literature), i.e. p{q{0)) = 
S[q—qo] with go — 0^, and where we have no perturbation 
fields, i.e. 9{t) = 0. Now the above results reduce to 



Cio = -crf[-Va] 



do = (a-K)' 



I]io = l-crf[-x/^-^e-3" 
Sii = 2 - ^e-3"[l - erf[iv^] + -^e-^' 



'an 



air 



The negative value of the correlation function Cio implies 
that for short times the traders will exhibit a tendency 
to alternate their (two) strategies. Let us now inspect 
the limiting behaviour of the above expressions for large 
and small values of a. For large a one obtains 

lim Cio = hm Gio = lim Eio = 

a — ^00 a — ^00 a — >qo 

In other words, the agents trade independently and ran- 
domly; for larger times this will continue to be the case. 
For small a, on the other hand, we find 



G 



1 



10 



'air 



Sn-— --L+0(a°) 
aiT \ cm 



So 77(1) = 0(a"5), whereas 77(0) = 0(a°). We also find 



([^(1) 



77(0) 



QfTT 



— Eoo = 0(a° 



from which it follows that 77(1) = —r\{^)l^fmi + 0{cP\ 
and hence we can write the first steps of the effective 
single agent equation ( |l7| ) as 

9(1) = <z(0) - a sgn[g(0)] + ^^77(0) 

= V^?7(0) + O(a) 
9(2) = q{\) - a sgn[g(l)] + aGioSgn[g(0)] + 

= -r;(0)/V^+O(V^) 

Thus also C20 = (sgn[q(0)g(2)])^ = 0{^) and C21 = 
(sgn[q(l)(7(2)])* = -1 + 0{Ja). We observe that for 
small a the first two time steps are driven predominantly 
by the noise component in (|l^). This noise component in- 
creases in strength and starts oscillating in sign, resulting 



in an effective agent which is increasingly likely to alter- 
nate its strategies. Equivalently, this implies that in the 
initial iV-agent system an increasing fraction of the pop- 
ulation of agents will start alternating their strategies. 

Let us finally inspect the initial behaviour of equation 
( |l7| ) for the intermediate regime where p{q{Q)) = 6[q — qo] 
with go = 0[\/a), to which (as we have seen) also for 
go = 0{a^) about half of the traders will automatically 
be driven in due course. We now put go ~ V^Qo and find 
in leading order: 



Cio=erf[i|go|] 



G 



^10 



1% 



10 



Sii = — e' 
an 



+ 



■2^0 



+ 



Thus we have ([77(1) -|- {an) «o/**?7(0)]^) — 0, so also 
77(1) = — (Q;7r)~2 e~9o/4^(o), in leading order for a ^ 0. 
This then, together with g(l) = 0{y/a) (which immedi- 
ately follows from (E2h), leads us to 



g(2) = -7r-^e-39o?7(0) + 0{V^) 

We thus find that also for go = 0{^/a) the initial condi- 
tions are more or less washed out by the internal noise 
generated by the process, within just two iteration steps. 



VII. THE STATIONARY STATE FOR a > ac 

For general a, not necessarily small, the arguments 
used in the second part of the previous section do not 
hold. In a stationary state, along with agents that will 
change strategy (almost) every cycle, there will gener- 
ally also be agents finding themselves consistently in the 
minority group, which will consequently play the same 
strategy over and over again. For the latter 'frozen' group 
(a term introduced in |lj]), the differences between the 
valuations of the two available strategies (i.e. the values 
of gi) will grow more or less linearly in time, whereas the 
'fickle' agents will have values for g^ very close to zero. In 
order to separate the two groups efficiently we introduce 
the re-scaled values qi{t) = qi{t)/t. Frozen agents will be 
those for which limj^oo <ji{t) 7^ 0. Similarly the effective 
single agent process ([l7| ) is transformed via q{t) — q{t)/t, 
where now the quantity = lim^^o hmf^oo(^[|g(OI ~^])* 
will give the asymptotic fraction of 'frozen' agents in the 
original iV- agent system, for N —t 00. The dynamical 
equation of the re-scaled effective agent can be written 
as 

g(i) = ig(l) + ^^,7(0 

t'<t 



--^Y.ll^^ + G)-l,Sgn[q{t")] 



(23) 



t' <t t" 



If the game has reached a stationary state, then Gtt' = 
Git - t'), Ctt' = C{t - t') and Stf = S(< - t'), by defini- 
tion. We will in this section assume that the stationary 
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FIG. 1. Asymptotic average c — limr^oo t^^ '}2t<^^ C{t) 
of the stationary covariance. The markers are obtained 
from individual simulation runs performed with a system of 
A'' — 4000 agents and various homogeneous initial valuations 
(where qi{0) = q{0)), and in excess of 1000 iteration steps. 
The solid curve to the right of the critical point is the theo- 
retical prediction, given by the solution of (p^. The dotted 
curve to the left is its continuation into the a < Uc regime 
(where it should no longer be correct). 



FIG. 2. Fraction 0=1- erf[^a/2(l + c)] of frozen 
agents in the stationary state. The markers are obtained 
from individual simulation runs performed with a system of 
N = 4000 agents and various homogeneous initial conditions, 
where qi{0) = q{0), and in excess of 1000 iteration steps. The 
solid line to the right of the critical point is the theoretical 
prediction, obtained from the solution of (p6|). The dotted 
curve to the left is its continuation into the a < Oc regime 
(where it should no longer be correct). 



state is one without anomalous response, i.e. temporary 
perturbations will not influence the stationary state and 
decay sufficiently fast, such that lim^^oo St<T ^(^) ~ ^ 
exists. This condition will be met if there is just one er- 
godic component; it is the dynamical equivalent of replica 
symmetry being stable (see e.g. [|8)) in a detailed balance 
model. We now define q — limt^oo git) (assuming this 
limit exists) and take the limit t — > oo in Eqn. (23). 
Under the assumption of absent anomalous response, we 
can use the two lemmas in appendix B to simplify the 
result to 



q = 



1 + k 



(24) 



with the averages s = limT-^oo X]t<T ^S^I?*] ^^"^ ^7 ^ 
limT-^oo 'YIiKt vi^)- The variance of the zero-average 
Gaussian random variable rj follows from (nSh : 



lim 

r.r' — >oo TT 



t<T t'<T 



^{l + k)-'[l+ hm 

r.r'— >oo TT 
= (l + fc)-^[l+(.2)] 



t<r t'<r' 



(25) 



Note that (s^) = linv^oo r'^ Y.t<T ^■ 

The effective agent is frozen if? ^ 0, in which case 
s — sgn[5]. This solves equation (|2j) if and only if |?7| > 
-/a/{l + k). If |?7| < + on the other hand, the 

agent is not frozen; now q = Q and s = (1 + k)iri/ ^/a. 



We can now calculate c = 



self-consistently, upon 



distinguishing between the two possibilities: 



1^71 



1 



1 



1^1 



(1 + kfrf 



Working out the Gaussian integrals describing the statics 
of rj, with variance (Eq), then gives 



1-(1- 



1 



a 



-) erf 



2(1 



- 2 



1 



2'Ka 



(26) 



From this equation the value of c can be solved numer- 
ically. For large a the solution behaves as c ~ . In 
figures |l| and g we show the solution of (^) and the frac- 
tion (j) of frozen agents, given according to the theory 
by = {9M - yS/(l + k)]) = 1 - erf[Va/2(l + c)], as 
functions of a, together with the values for c and (j> as 
obtained by carrying out numerical simulations of the mi- 
nority game. One observes excellent agreement between 
theory and experiment above a critical value ac, which 
we will calculate below. 

From the time-averaged asymptotic correlation c we 
next move on to calculate the integrated response k = 
\iinr^ooJ2t<T ^(^)- Since the occurrence of the Gaus- 
sian noise term r](t) in Eqn. ( |l7| ) is (apart from a factor 
^/a) similar to that of an external field, we can write the 
response function as Gtt' = a~^{d sgn[q{t)]/^r|{t'))^,. In- 
tegration by parts in this expression generates 



7 



{d sgn[q{t)]/dv{t')). ^Y.^-l„{sgn[q{tMt")). 



and hence 



■T 

t"t' 



{sgn[q{tMt')). (27) 



Averaging over the two times t and t' now gives in 
a stationary state, upon using again the assumption 
of absent anomalous response (and the familiar nota- 
tional conventions s — limT-^oo St<r ^S^fel^)] ^^"^ 
V = limr^oo J2t<T sgn[g(t)]): 



r^oo T ^ — ^ ^ — ^ 



(28) 



The variance (77^) is given in (|25|). We calculate the re- 
maining object (577) similarly to our calculation of c, by 
distinguishing between frozen and non-frozen agents and 
by using the two identities s — sgn[77] (for frozen agents) 
and s — 77(1 -|- k)/y/a (for the non-frozen ones), both of 
which follow immediately from (p4). This results in 



(sr,) = {9 



1 + k 



1 + k 



ry2(l + /c)^ 



(1 + A:)v^ 



erf 



2(1 + c) 



Insertion into (pq), together with (25), then gives the 

(29) 



desired expression for the integrated response: 

a 



1 

k 



erf[ 



1 



2(l+c) 



with the value of c to be determined by solving Eqn. (26) 
Equivalently, using </) 1 - erf[Va/2(l + c)] we get 



1-0 
a - 1 + 



(30) 



The integrated response k is positive and finite, and 
hence our solution (based on this property) is exact, for 
a > ac- Here Uc is the point at which k diverges, which is 
found to happen when the fraction of fickle agents equals 
a. According to (^6 29) we can write ac as Uc — erf [a;], 
where x is the solution of the transcendental equation 



erf[x] 2 - 



1 



(31) 



The resulting value ac ~ 0.33740 is identical to that 
found in (for a stochastic version of the game) using 
replica calculations. Below ac there might well be mul- 
tiple ergodic components, i.e. more than one stationary 
solution of our fundamental order parameter equations 

(II)- 



VIII. STATIONARY VOLATILITY FOR a> ac 

In contrast to the persistent order parameter c and 
its relative fc, the volatility matrix ( jq), to be calculated 
within our theory from expressions (18 20) and in a sta- 
tionary state of the Toeplitz form Stc — S(t — i'), gen- 
erally involves both long-term and short-term fluctua- 
tions. This becomes apparent when we work out S(i) 
using ( |l8|) and the results of appendix B. We separate 
in the functions C and G the persistent from the non- 
persistent terms, i.e. C{t) = c-\- C{t) and G{t) — G{t) 
(there is no persistent response for a > ac), and find 



2S(t) 



1 



(l + fc)2 

.1™ ^ E E(i + A't"{^ + G^)A (32) 



U<T ft" 



Clearly, the asymptotic (stationary) value of the volatil- 
ity — S(0) cannot be expressed in terms of persistent 
order parameters only. It requires solving our coupled 
saddle-point equations ( p^ for Gtt' and Gtt' for large 
times but finite temporal separations t — t' . The persis- 
tent market correlations, however, are found to be ex- 
pressible in terms of persistent order parameters: 



S(oo) 



1 



2(l + fc)2 



(33) 



In order to find the volatility we separate the correlations 
at stationarity in a 'frozen' and a 'fickle' contribution: 

G{t - t') - 0(sgn[9(i)g(t')])fr + (1 - <^)(sgn[g(t)g(t')])fl 
= (^+(l-</.)(sgn[g(t)]sgn[g(0])fi 



and hence 

C(t ^ t') = 
Insertion into (^ 

l + <b 



2a' 



{l + kf 



i-c+(l-0)(sgn[g(i)]sgn[g(t')])fi 
) and putting t = Q then gives 

(1-0) hm - 

T — >QO T 



t<T ft" 



X (l + G),-,^(sgn[g(t')]sgn[g(t")])ft(l 



t<T yf<t 



+ G)7,,isgn[g(t')] ) )fi (34) 



We note that the sum X]t'<t(l + G)^^l'sg^a\q(t')], is the 
retarded self- interaction term in equation ([17|). Such a 
term is a familiar ingredient of disordered systems with 
'glassy' dynamics (see e.g. ||l^), and generally acts as the 
mechanism which drives the system to a 'frozen' state. 
Hence, self-consistency of the distinction between frozen 
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FIG. 3. The volatility ct as a function of the relative num- 
ber Q = p/N of possible values for the external information. 
The markers are obtained from individual simulation runs 
performed with a system of A'^ = 4000 agents and various 
homogeneous initial conditions, where qi{0) — q{0), and in 
excess of 1000 iteration steps. The solid curve for a > Uc is 
the approximate expression (M). Below Qc the approximate 
asymptotic solutions of Eqnsr(pl[) (solid) and (p2) (dashed) 
are drawn. 

and fickle traders dictates that the retarded self- 
interaction term can be large for frozen traders, but must 
be small (if not absent) for fickle ones. Our approxima- 
tion now consists in consequently disregarding the re- 
tarded self-interaction for the fickle traders: 



1^1 < 



t'<t 



Thus we retain for fickle traders only the instantaneous 
t' = t term in '^H<ti^ + G)^^}sgn[q{t')], and find the (ex- 
act) expression (BJ) being replaced by the approximation 



2(l + fc)2 ^ 2^ 



(35) 



This turns out to be a surprisingly accurate approxima- 
tion of the volatility for a > etc, as can be observed in 
Fig.! 

Only in the limit a — > oo can we expect to be able to 
go beyond ( |3^ ) and (p5|), and work out expressions (^) 
and (p4h exactly. This requires calculating the response 
function G(r) for small r, which we will set out to do 
next. Since we assume absent anomalous response we 
may choose trivial initial conditions. We also choose the 
perturbation fields 9{t) to be non-zero only for a given 
time t — T, where r > 0. From (n% we now derive 



sgn[g(<)] = sgn 



t't"<t 



(36) 



Hence, for vanishingly small perturbations 9(t — r), and 
upon taking the t oo limit: 



G(r) 



lim 



1 + fc t-^'<^ t 



-2((5 



dsgn[q{t')] 



lim — „ , 

t^oo t 80 (t 



de{t' - r) 
dvit') 



We observe that rj — Sy/a/{l + k) is precisely the 
condition for a trader to be fickle, in the language 
of the effective single agent. Secondly, from causal- 
ity it follows that limj^oo X]t'<t "''') = 
\irat^oct^^J2l'=t-r+i'^v{t')/9d{t - r) = 0. Hence our 
result can in a stationary state be written as 

= — iTi^^'^^m^^' ^^^^ 

For a oo our stationary order parameter equations 
give (1 — (/))/(l + fc) — > 1. Furthermore, for a ^ oo all 
traders will become fickle, so {dsgn[q{t)]/d9{t — r))fi 
G(t). This leaves for a — s- oo only the trivial solution 
for equation (|3^): lima^oo G'(t) = for all t. Insertion 
into our exact expression ( ^2|) for the stationary volatility 
matrix gives 



lim E{t) 



1 lim C{t) 



and hence 



lim lim a 

a—*QO t—*QO 



(38) 



This is the random trading limit. 



IX. THE STATIONARY STATE FOR a < ac 

When the amount of external information available for 
agents to base their actions upon (i.e. the value of a), 
becomes small, the behaviour of the market is found to 
become strongly dependent on initial conditions. Numer- 
ical simulations show that below ac the sequence Gu' 
is unbounded, and that within the limits of experimental 
accuracy: 



ii-E(i + G)- = o 

t' 

Gt+r,t = c + d{-lY for r^O 



(39) 
(40) 



(with Ctt = 1, by definition). Figure ^ shows the asymp- 
totic values of d as measured during numerical simula- 
tions, for different values of a and g(0). One clearly ob- 
serves the dependence on initial conditions. 
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q(t+l) = q{t) + 7ZVW(-1)* + 

-a^(l + G),-isgn[q(t')] (44) 
t'<t 

Frozen agents are those for which sgn[g(t)] is independent 
of time; due to ( ^9|) these wiU not experience the last term 
in ( PI ) . However, due to the properties of the noise in the 
a < Uc regime (and in contrast to the situation with a > 
ttc), even frozen agents will now have limt_>co (l{t)/t — 0. 
Insertion into Eqn. (|^ shows that frozen solutions of 
the following form exist: 



1 



(45) 



provided sgn[g(t)] = sgn[g] for all t, so q and d must obey 



FIG. 4. The oscillatory component d of the covariance 
(see equation (^)). The markers represent the results of in- 
dividual simulations, performed with A'^ = 4000 agents and 
various homogeneous initial conditions, where gi(0) = g(0), 
and after in excess of 1000 iteration steps. 



1-c, 



We will now use (39|40|) as ansdtze, i.e. we will con- 
struct special self-consistent stationary state solutions of 
the fundamental order parameter equations ( p^ which 
obey (39 iO), as well as the stationary state conditions 
Ctt' = C{T— t') and Gu' = G{t — t'). First we analyse 
the statistical properties of the Gaussian noise rj{t) in the 
single agent equation (|l^). From (^,^^ it follows that 
the noise covariance matrix (^8|) obeys 

lim {-qit + T)ri{t)) = {-lYd-j^ + 



(1 



in which 



d)J2{^ + Gr\t + r){l + G)-\t) (41) 



^(l + G)-i(t)(-l)* 



(42) 



From ( ^ ) one can derive, in turn, that the noise variables 
must asymptotically take the form: 



oo 



r]{t) = {^ifjzVd + ^{t)Vl-c-d (43) 



where z and {^(i)} are zero-average Gaussian variables, 
with ^ 1, (z^{t)) = 0, and 

hm (at + rm) = E(i + Gy'(t + + Gr\t) 

t—^oo ^ — ^ 



Due to ( pOj ) we know that linv^oo lim(_,oo {i{t+T)S,{t)) = 
0, i.e. in the stationary state the ^(t) decorrelate for large 
temporal separations. For sufhciently large t, and with- 
out external perturbations, equation ([l7| ) now acquires 
the form 



\q\ > {--yzVadl 



(46) 



Oscillating agents, on the other hand, are those for which 
sgn[g(t)] — (t(— 1)*, with a = ±1. Insertion into Eqn. 
(E3) shows that oscillating solutions of the following form 
exist: 



1 



q{t) ~ q + -7<5'[a — zaVad] (—1)* 



(47) 



provided sgn[g(t + 1)] = — sgn[(7(t)] for all t, so q and d 
must obey 

d= 1 — c, jla — zaVad] > 0, \q\ < —'-f[a — zaVad] 

(48) 

Note that, if rigorously frozen and/or rigorously oscil- 
lating agents were to be asymptotic solutions of ffl), 
then the correlations would have come out as C(t) = 
(1 — <j)){—iy (with (j), as before, denoting the fraction 
of frozen agents), and we would have found c + d = 1. 
Figures |^ and ^, however, show that this simple relation 
holds only near a = 0. Away from a = there will there- 
fore be solutions describing fickle agents which change 
strategy at intervals intermediate between one (oscillat- 
ing) and infinity (frozen). This can be understood on the 
basis of (^), where due to the noise term ^{t) (with a 
finite temporal correlation length) there will for c + d < 1 
always be a non-zero probability of nearly frozen agents 
changing strategy occasionally, and of nearly oscillating 
agents not changing strategy occasionally. 



X. THE LIMIT a 







Let us finally investigate the situation near a — more 
closely, where we may use the experimental observation 
that c + d « 1, which implies that all agents will be 
either frozen or oscillating. We put c = <j) (the fraction of 
frozen agents) and d — \ — (j)^ and choose homogeneous 



10 



initial conditions with g(0) > 0. We now find 'ri{t) - 
(— l)*7z^ (1 — (p) and our two solution types given by: 

frozen : q{t) 
oscillating : 



1 



lit) = 1+ ifl^W - za.Ja{l-(t>)]{~lY 



provided the following respective conditions for existence 
are met: 



frozen 
oscillating 



1 



\q\ > 



Near a = we also know, due to c + = 1 , that 
t^^: (ry(t + rMt)> = (-1)^(1-0)72 

„2 



(49) 



(50) 



(51) 
(52) 

In order to elim- 



and that linif^^oo cr^ ~ ~ '^)^'^ 
inate the remaining parameters 7 and (j) we note that 
time translation invariance guarantees the validity of the 
relation Et(G")(t)(-l)* = Et G'(t)(-1)*]", and hence 



7 



(i + r)-i r = ^G(i)(-i)* 



(53) 



The quantity F can, in turUjbe expressed in terms of 7 
upon inserting (|5l] , p^ into (p7|). We obtain 

y^(l - 0)7(1 - 7)(-l)" = lim (sgn[g(t + rMt))^ 

t — *CXD 

Working out the average in the right-hand side, by sepa- 
rating frozen from fickle solutions, gives for large t: 

(sgn[g(t + r)]r7(t)). = (sgn[g(< + r)]r;(t))fr 

+ ( 1-0) (s gn[g(t+r)]r;(0)fi 

= 7y(T^(-l)" {0(-l)*(sgn[q]z)fr 
+ (1-0) (az)fi} 

Since in a stationary state the correlation function 
(sgn[q(i)]77(t'))^ can only depend out — t' , we must con- 
clude that (sgn[g]z)ti. = and that cither 



lim 7(1^ 







or 



7 



1- 



1^ 



(<Tz)fi (54) 



(in leading order for a ^ 0). Multiplication of both 
sides of the second equation in ( ^^ by 7-^/0 shows that it 
automatically ensures the validity of the second condition 
of (|50|). The first equation of (54) will satisfy the second 
condition of ( po| ) as long as 7 > 0. 

In order to proceed we need to calculate the persistent 
term q in the proposed solutions, which can be seen as 
representing their 'effective initial conditions'. It incor- 
porates both the true initial conditions and the effects of 



the transients of the dynamics, which initially will not 
be of the simple form (|4J). Exact evaluation would re- 
quire solving our order parameter equations for arbitrary 
times, which is not feasible. However, one can for now 
proceed on the basis of the postulate that the properties 
of the long-term attractors (viz. the Gaussian variable 
z) are uncorrelated with the value of q. The conditions 
(^,^^ then simply state whether a value of g, generated 
independently of z according to some distribution P((?), 
is compatible with a given attractor. Although we will 
not be able to generate all possible stationary solutions of 
the process (17^, wc will show how two qualitatively dif- 
ferent solutions, one with a diverging volatility for a — > 
and one with a vanishing volatility for a — > 0, can both 
be extracted from our equations. 

The first type of solution is obtained for lima^o — 
00 < 1. Now one finds, in leading order in a , that 
a — — sgn[7zj and that 7 = (|z|)g-\/(l — 0o)/q^- The 
conditions ( |4^ , pO| ) reduce in leading order to the comple- 
mentary pair 



frozen : 



1 



\q\ > -7|z|v/a(l -0o) 



oscillating : |g| < -7|z| Va(r^^0o) 
This, in turn, allows us to calculate 0n and ( 



(55) 
(56) 



\z\)fi- 



= jdq P{q) j ■ 
^ Jdq P{q) erf 



dz 



\q\-\l\z\.M^ 



7\/a(l 



■rfg P{q) f dz \z\ _i^2 



1-00 
V2 



(l-0o)v^ 



dq P{q) 



\l\zWa{l-<j)t))-\q 



,-29V7"q(1-0o) 



We eliminate 7 in favour of ct = ^\/27\/l — 0o a-nd end 
up with the following simple closed equation for a: 



n= dq P{q) 



/QfTT 



The associated value for 0o then follows from: 



j dq P{q) erf 



(57) 



(58) 



Finally we can use our observations regarding the first 
few time-steps (section VI) of the process in order to ob- 
tain an estimate for P{q). These showed for small a that 
initially (i) for small |<7(0)| — 0{-\/a) the system is driven 
towards the oscillating state, (ii) for large \q{0)\ — 0{a^) 
the system tends to freeze, (iii) the transient processes 
are dominated by the (Gaussian) noise term in dl^), and 
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FIG. 5. Experimental evidence in support of the existence 
of a critical value for the initial strategy valuation q(0) below 
which a high-volatility solution exists. The connected mark- 
ers represent the results of measuring the volatility in individ- 
ual simulations, performed with A'^ = 4000 agents and initial 
conditions where qi{0) = q{0), and after in excess of 1000 it- 
eration steps. CPU and memory limitations prevent us from 
doing reliable and conclusive experiments for a < 0.0125; the 
available data, however, are clearly not in conflict with our 
theoretical prediction Qc ~ 0.242 (vertical dashed line), which 
follows from equation dss]). 

(iv) the noise term is automatically being 'amplified' (ei- 
ther via a diverging response function, or via accumula- 
tion over time) to an effective 0{a^) contribution. Note 
that (i) and (ii) confirm that q can indeed be seen as the 
sum of q{0) and the net effect of the transient processes, 
and that (iii) and (iv) subsequently suggest represent- 
ing the transient processes by adding a single effective 
Gaussian variable. Hence for small a it would appear 
sensible to write P{q) = (A\/2^)-ie"5['?-9(o)]VA' ^ which 
converts ( |57| , p8|) into 



2A' = -e 
n 



1 2g2(0) 



We conclude that a can be written in terms of the solu- 
tion y of a transcendental equation 



1 



V(0) 

y 



For |g(0)| ^ we find that a = 
we must obviously require A'^ 
value for (j)Q then follows from: 



2g2(o) = le-y (59) 

TT 

{aTr)^i\/l — 27rA2, hence 
< l/27r. The associated 



Dx erf 



1-7(0) + Aa;| 



(60) 



Since we cannot calculate or estimate the width A of 
the effective Gaussian noise term without solving our or- 
der parameter equations for short times (A could even 
depend on <z(0)), it is quite satisfactory that several in- 
teresting properties of the solution are found to be inde- 
pendent of A. For instance, one always finds a diverging 



volatility of the form a = 0(a 2 ), and there is a critical 
value qc = (27re)~5 « 0.242 such that for |g(0)| > qc 
the solution no longer exists. This solution is clearly the 
type of volatile state which has been reported regularly 
(see e.g. upon observing numerical simulations. We 
have now found, however, that whether or not it will ap- 
pear depends critically on the choice made for the initial 
conditions. Numerical simulations indeed appear to sup- 
port the existence and predicted magnitude of a critical 
value qc ~ 0.242 (see figure |5]); fully conclusive experi- 
ments, however (with even smaller values of a), would 
require impractical amounts of CPU and/or memory in 
order to meet the requirements p — > 00 and N —^ 00 for 
increasingly small values of a, and are presently ruled 
out. In the limit q{0) — > one can easily carry out the 
integrals in (|60|), giving A = (27r)~2 sin[i7r(/)o]- Elimina- 
tion of A via insertion into a = {air)' 
leads to the simple relation 



■5\/l - 27rA2 then 



a, (7(0)^0 



+ 0(a°) (61) 



This is the high-volatility solution shown in the a < ac 
regime of figure |^, with 0o SiS measured in simulations 
(see e.g. figure ||). The power of a in ( |6l] ) is observed to 
be correct. The observed difference between theory and 
experiment with regard to the prefactor can be under- 
stood as a refiection of our approximation c + d « 1; 
this amounts to disregarding deviations from the ide- 
alized 'purely frozen' or 'purely oscillating' behaviour, 
which can indeed be expected to give an approximate 
theory which (even for small a) slightly under-estimates 
the volatility. 

We note that the condition lima^o < 1 for the 
above reasoning to apply can in fact be weakened to 
limc^oQ!/(l — 4>) =0. The above solution ceases to 
hold, however, at the point where the fraction of frozen 
agents scales a.s <j) — l — Ka+Oia^ ), in which case we have 
to turn to the first option in (p4|), rather than the second. 
This is consistent with our previous observation that 
small values of \q{0)\ lead to a relatively small fraction of 
frozen agents (and a large volatility), whereas for large 
\q{0)\ such a solution will break down in favour of states 
with a larger fraction of frozen agents. Since we can 
now no longer use the second equation in ( ^4[ ) to deter- 
mine 7, and hence find the volatility a = ^^/2^\/l — 0, 
we have to return to (|5^). A fully frozen state, which 
for a ^ will indeed be described by this second type 
of solution (since lim|-j_+o = 1), must necessarily have 
G{t > 0) = g. This is consistent with our ansdtze, since 
it gives 



t > 



(l + G)-i(t) = -.g(l-g)* 



which implies I]t>o(l + G)"^(i) = 0, provided < .g < 2. 
We can now calculate 7 from ( |5^ ) and find linia^o 7 — 
2/(2 - .g). Thus we obtain, provided 2- g = 0{a°): 
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(l-(|))/a 




FIG. 6. Experimental evidence for the existence of the 
limit K = lima^o(l — for the low-volatility solution. 

The markers are obtained from individual simulation runs 
performed with a system of A'^ = 4000 agents and initial 
valuations of the form qi{0) = q{0) > Qc (to evoke the 
low- volatility state), and in excess of 1000 iteration steps. 
The solid curve to the right of the critical point is the theo- 
retical prediction, obtained from the exact equations ( p^ and 
(j> = 1 — erf[^ q/2(1 + c)] describing the a > ac regime. The 
dotted curve to the left is its continuation into the a < Oc 
regime (where it should indeed no longer be correct). 



/2k 



2-( 



0{a) 



lim ■ 



We also note that the scaling property (p — 1 — 0{a) 
impHes that P(0) — \imq^oP{q) — 0{^/a), since all q 
values of order q = 0{y^) will contribute to the fraction 
1 — of fickle agents, giving 1 — = O{P{0)y^). We 
can now calculate liniQ^o 9 upon explicitly inspecting the 
effect of a perturbation of a frozen state. In view of 
G{t > 0) = g we may restrict ourselves to considering 
the effect on sgn[g(i -I- 1)] of a perturbation at time t, 
giving in leading order for a — > 0: 



lim q = lim lim ( -— sgn 



q + -ajz^/ni—iy + i 



= 2 hm (S 



q+ -a7z^^■(-l)' 



= 2 lim P(0) = 

Hence, since the frozen state has q — ©(a"), we find 
lim„^o 7=1 and 



: 



(62) 



Explicit calculation of the prefactor in ( p^ ) would require 
taking our calculations beyond the leading order in a, in 
order to determine to find k. Equation ( |6^ ) is the low- 
volatility solution shown in the a < Uc regime of figure 



^, with K as measured in simulations (see e.g. figure |^). 
Again the power of a in (62) is observed to be correct. 
The remaining difference between theory and experiment 
with regard to the prefactor can again be understood as 
a reflection of our approximation c+d fa 1, which induces 
a structural under-estimation of the volatility. 



XI. DISCUSSION 

In this paper we have solved a 'batch' version of the 
minority game with random external information, using 
generating functional analysis (or dynamic mean field 
theory) a la De Dominicis, which allows one to carry 
out the disorder averages in a dynamical context. Since 
the dynamics of the game is not described by a detailed 
balance type stochastic process, equilibrium statistical 
mechanical tools can not be applied directly. Phase 
transitions (if present) must be of a dynamical nature. 
The disorder in the minority game consists of the mi- 
croscopic realisation of the repertoire of randomly drawn 
trading strategies of the N agents. Upon taking the limit 
N oo (where N denotes the number of agents play- 
ing the game) one ends up with an exact non-Markovian 
stochastic equation describing the dynamics of an effec- 
tive single agent (|l7|), whose statistical properties are 
identical to those of the original system (averaged over 
all realisations of the disorder). The key control param- 
eter in this problem is the ratio a = p/N of the number 
of possible values of the external information over the 
number of agents. 

We find a phase transition at ac = 0.33740, signaled 
by the onset of anomalous response, in agreement with 
the value reported recently in The method used in 
Q depends on the fact that for their stochastic version 
of the minority game a Lyapunov function exists. Our 
approach does not have this constraint and can be easily 
applied to those variations of the game where a Lyapunov 
function is not available, thus opening up a wider range 
of models for analysis (see e.g. |^). Above ac (where 
anomalous response is absent) we can solve the station- 
ary state of the system exactly, giving exact expressions 
for quantities such as the fraction of frozen agents (which 
is zero for a oo but increases with decreasing a), the 
persistent two-time correlations, and the persistent corre- 
lations in the total bid. The volatility (which is itself not 
an order parameter of the system) can be calculated to 
a very good approximation. Above ac, our method and 
that of 1^,^ are likely to describe the same behaviour 
|pO| . Below ac, i.e. in the region of complex dynamics 
(inaccessible by the replica approach iQ), our present 
method still applies. In this region we demonstrate the 
existence of multiple stationary states, and derive expres- 
sions for the relevant observables in leading order in a as 
a 0. We show, more specifically, that the occurrence 
and practical observability of a diverging volatility for 
a ^ (as reported in e.g. MM) is crucially dependent 
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on the overall degree of a priori preference for specific 
strategies exhibited by the agents at i = 0, which may 
explain the different observations regarding the a ^ 
behaviour which have been reported in literature [^ . 
More specifically, our theory points at the existence of 
a critical value for the initial strategy valuations, above 
which the system will revert to a state with vanishing 
volatility. Our theoretical predictions find quite satisfac- 
tory confirmation in numerical simulations. 

The fact that we can analyse the stationary state of 
Eqn. (|l^), in spite of it describing a non-Markovian 
stochastic process, suggests that the present method 
should also be suitable to deal with models where the 
external information depends on time, or on the previ- 
ous behaviour of the agents, as in the original model [P. 



ments by Challet et al. 2000 cond-mat/0004308 



[14] 
[15] 
[16] 
[17] 
[18] 
[19] 
[20] 



2000 



reply by Cavagna et al. 

M. Marsili and D. Challet, to appear in Adv. in Complex 



:ond-mat/0005134 



and the 



Sys., |cond-mat/0004376 



H. Sompolinsky and A. Zippelius, Phys. Rev. B. 25, 6860 
(1982). 

H. Eissfeller and M. Opper, Phys. Rev. Lett. 68, 2094 
(1992). 

D. Cha llet and M. Marsi li, Phys. Rev. E 60, R6271 
(1999), |sond-niat/9904071 . 

M. Mezard, G. Parisi, and M. Virasoro, Spin Glass The- 
ory and Beyond (World Scientific, Singapore, 1987). 
K. H. Fischer and J. A. Hertz, Spin Glasses (University 
Press, Cambridge, 1991). 
Private communication with M. Marsili. 



ACKNOWLEDGMENTS 

We would like to thank Andrea Cavagna and David 
Sherrington for introducing us to the Minority Games 
and Matteo Marsili for a discussion of previous work 
done. JAFH wishes to thank King's College London As- 
sociation for financial support. 



[1] 

[2] 

[3] 



[4] 

[5] 
[6] 
[7] 

[8] 
[9] 



[10] 

[11] 
[12] 

[13] 



D. Challet and Y.-C. Zhang, Physica A 246, 407 (1997). 
W. Arthur, Am. Econ. Assoc. Papers and Proc. 84, 406 
(1994). 



D. Challet, littp://www.unifr.ch/econophysics/minority 
(an extensive commented collection of work on the mi- 
nority game) . 

D. Challet, M. M arsili, and R. Zecch ina, Phys. Rev. Lett. 
84, 1824 (2000), |cond-mat/9904392 , 
M. Marsih, D. Challet. and R. Zecchina. Physica A 280, 



522 (2000), |cond-mat/990848(]t 



A. D. Martino and M. Marsih, |3ond-mat/0007397| (un- 
published) . 



N. Johnson, M. Hart, and P. Hui, |r:ond-mat/9811227| , 
(unpublished). M. Hart, P. Jefi'eri es, P. Hui, and N. Jo hn- 
son, to appear in Eur. J. Phys. B, cond-mat/0008385. M. 
Hart, P. Jeflteries, a nd N. Johnson, to appear in J. Phys. A, 
cond-mat/0005152[ 

R. Savit, R. Manuca, and R. Riolo, Phys. Rev. Lett. 82, 
2203 (1999). 

R. Manuca, Y. Li, R. Riolo, and R. Savit, Technical Re- 
port No. pscs- 98- 11-001, University of Michigan, (unpub- 
lished), www.pscs.umich.edu/RESEARCH/pscs-tr.html. 
C. De Dominicis, Phys. Rev. B 18, 4913 (1978). 
A. Cavagna, Phys. Rev. E 59, R3783 (1999). 
J. Garrahan, E . Moro, and D. Sher rington, Phys. Rev. E 
62, R9 (2000), |cond-mat/0004277[ 

A. Cavagna, J. Garrahan, I. Giardina, and D. Sherring- 
ton, Phys. Rev. Lett. 83, 4429 (1999), see also the com- 



APPENDIX A: EXPRESSIONS FOR AVERAGE 
BID AND VOLATILITY 



First we calculate limAr_+oo (^t) using expression (|^). 
We note that we obtain {At) simply by making the re- 
placement e^T.u'Piit)<iiit) _> [T/aN)Y,^x'i in the right- 
hand side of Eqn. (|^). The disorder average is carried 
out as before, but instead of Eqn. (Q) we now obtain 



{At) = r [DCDC][DKDK][DLDL\ e 



X e-"^/" iDwDwDxDx x\ e^i:eK'"=+SaX.+™.^.] 



ss'l'^s't^ s' -\-WsL ^^/W^/ '\-2XsK ^g/W^/ -\-XsC^^fX^f] 



where we have used permutation invariance with respect 
to fi (after the disorder average). The integral is domi- 
nated by the familiar saddle-point. Since the ©(iV^) term 
in the exponent is identical to that in (|^), we can now 
simply use the identity Z[0] = 1 to show that 



hm {At) 

N—^oo 



DwDwDxDx Xt e 



X e 







(Al) 



The last step follows immediately from the anti- 
symmetry of the integrand under overall refiection. 

To determine the disorder-averaged volatility ma- 
trix, whic h fo r ^ oo becomes identical to {At At') 
due to ( |Al| ) and the self-averaging property, we 
first work out the dominant terms in (|^). Using 
limjv-,oo(a-^)^"'^ X]u — \^ obtain the relatively 



simple expression 



hm {At At' 

N^oo 



lim ^— + n^'/T]\x1, + 17^ /rl) 

Or.AT * / JL (' i /J/ 
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We calculate this average by making the replacement 

in the right-hand side of Eqn. (||) . Repeated integration 
by parts over the shows that we may equivalently 
put e*^"''''W9-W ^ {2aN)-^J2^w'^w'i^,. FoUowing the 

steps we also took in calculating {A) now gives 



hm {At At' 

A^— >oo 



— -e I DwDwDxDx WtWt>e 



X e 2 



J2 s [Ws'^s-^^sXs-\-WsXs 



1 / Dw wtWt' e 
2 



1, 



(A2) 



APPENDIX B: CONSEQUENCES OF ABSENCE 
OF ANOMALOUS RESPONSE 

Lemma 1 Consider two bounded sequences of real num- 
bers At and bt- Because bt is bounded, there exists 
a number b such that lim,-_+oo 7 X]t<T ^* ^ ^- Define 
aT = "YlitKr ^t, o,nd assume that hm^-^oo olt = i- Then 

lim - V V At_t.6; ^ ab 

t<T t'<t 

Proof Upon substituting of t ^ t + t' wc find 



t'<T t<T-t' 



The sequences {a} and {6} are bounded, so there exist 
numbers and Cj, such that \at\ < Ca and \bt\ < Cf, 
for all t > 0. The sequence {a} converges to a, so for 
any e > there exists an K such that for all t > K: 
\at — a\ < e/iCb- We now choose M such that for all 
^ > \\Y.t<rbt -b\< e/3|a| and KCaCb/r < e/3. 
Then we find for all t > M: 



< 



- ar-tbt + - E o.T-tbt - ab 



t = T~K 



t<T~K 



^'^o.r-tbt - ab 

E ar-tbt 

t = T-K 

- ^ [or-t - a)bt - a I 6 - - ^ bt\ 

t<T-K \ t<T-K / 

- ^ {ar-t-a)bt + \a\b-- ^ 6, 



KCaCb 



t<T-N 



t<T-K 



Lemma 2 Suppose Gst = G(s — t) € 5f, where G{t) = 
for all t < Q and with liniT-^oo X]t<T G(^) ^ '^'^'^ 
suppose limr^oo X]t<T ~ ^- Then for all n e N; 

lim i VV(G")„,5(0 = fc"s. 

T— *oo T ^ — ^ ^ — ^ 

t=l t' 

Proof The proof proceeds by induction. For rt = 0, the 
statement is trivially true. Suppose now that it is true 
for all n < m. Then 

1™ -EE(G'""*'')"-(^') = 

hm i^^G(t-t") 5](G""W.(0 

T— *oo T — ^ — ^ — ^ 

t=l t"<t t'<t" 

The sequence 64 = J2t' <ti^"^)tt' ^i^') satisfies the condi- 
tions of the preceding lemma, application of which gives 

1 ^ 

lim - y y"(G"'+^)tt's(t') = k.k"'s = k"'+h 



t = l t' 



Hence the claim holds for m -f 1, and by induction it is 
now proved for all n. ■ 



< e 



Hence the limit is as claimed. 



15 



